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Abstract: From the study of a functional equation relating the Gibbs measures at two 
different tempratures we prove that the specific entropy of the Gibbs measure of the 
Sherrington-Kirkpatrick Spin Glass Model vanishes at the inverse temperature /3 = 4log2. 



(N 

9^ 1 Introduction and main results 

■5: 

Over the last decade, mean field models of spin glasses have motivated increasingly 
many studies by physicists and mathematicians [1, 4, 5, 6, 7, 8, 9, 11]. The existence 
of infinite volume limit of thermodynamic quantities is now rigorously established 
thanks to the development of numerous remarkable analytical techniques. For the 
Sherrington-Kirkpatrick model, the first major results of Guerra and Toninelli [5] on 
existence and uniqueness of the free energy, are generalized by Aizenman, Sims and 
Starr [2] in a scheme giving variational upper bounds on the free energy. Talagrand 
[11], under some conditions on the overlap function, contributed to the entirely rigor- 
(N) ! ous account of the original formulae proposed by Parisi [8] . 

An interesting question, related to the behaviour of Gibbs measures, is the study 
of their specific entropy. Despite the numerous developments achieved lately on this 
model, the study of the properties of the entropy is still missing in the literature. The 
specific entropy decreases with the temperature and the high temperature entropy can 
easily be estimated. By lowering the temperature the entropy should eventually vanish 
and an early result, given in [1], corroborates the idea that the entropy does not vanish 
very fast. In this note we estimate the value of the (low) temperature at which the mean 
entropy of the Gibbs measure vanishes. 

The approach we use here is totally self-contained. From the low- temperature re- 
sults, we need solely the existence of the thermodynamic limit of the quenched specific 
free energy and its self- averaging property. 

We first recall some basic definitions. Suppose that a finite set of n sites is given. 
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With each site we associate the one-spin space Z := {1,-1}. The natural configuration 
space is then the product space Z„ = {- 1, 1}" = Z", with cardZ„ = 2 n equipped with the 
uniform probability measure v n . For each a £ Z„, the finite volume Hamiltonian of the 
model is given by the following real-valued function on Z„ 

1 

H n {a) = — — 2^ hjOiOj, 

V" l<i< j<n 

where the family of couplings / = {Jij)\<i<j< n are independent centred Gaussian ran- 
dom variables of variance 1. 

At the inverse temperature p = j > 0, the disorder dependent partition function 
Z n (/3,J), is given by the sum of the Boltzmann factors 

a 

Moreover, if Ej denotes the expectation with respect to the randomness /, it is very 
simple to show that E;Z n (p,J) = 2 n e^ in - 1] . 

When the randomness / is fixed, the corresponding conditional Gibbs probability 
measure is denoted by n n ,p^\J) and given by: 

e -PH„{a,J) 

The entropy of \i n #, is defined as usual by S{\x n<?)i j) = - L CT Vn,f> (&\J) logju n>i g {a\J). 
The real functions 

f n {P) = -EjlogZ n (p,J) 
n 

and 

J n {p) = UogEjZ n {p,J), 

define the quenched average of the specific free energy and the annealed specific free 
energy respectively The ground state energy density -e n {J) is given by 

-e n (J) = - inf H n (a,J). 

n CTEl n 

At the low temperature region (/3 > 1), the following two infinite volume limits 

timfniP,J) = fooW, 

n— >oo 

and, 

- lim e n {J) = lim hz^-L = - €q 

exist for almost all / and are non random; this result has been rigorously proved by 
Guerra and Toninelli [5] . 
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The main results of this note are stated in the following and proved in the next 
section. 

Proposition: Almost surely, at the inverse temperature /3* = 4log2 = 2.77258- ••, the 
thermodynamic limit of the quenched free energy is given by 

1 B 2 B 2 1 

fooifi*) = lim -Ej\ogZ n (B*,J) = /^l) + (j6, - l)log2 = ^± + 0. = B , l og 2 + -. 

n^oo n 444 



The Parisi formula provides with the expression of the free energy for the entire low 
temperature region in terms of a functional equation; the pertinence of the precise cal- 
culation of the limit at a particular value of the temperature stems from its usefulness 
in determining the point where the entropy vanishes. This gives new insight to the 
behaviour of the model and is summarised in the following 

Theorem: At the inverse temperature (5* = 4log2 = 2.77258 •• •, the specific entropy s(pp J 
of the Gibbs measure vanishes almost surely: 

s(jU« ):= lim -S{p n « 7 ) = - lim - Y [i n « {o\JMo%p, n « {a\J) = 0. 

Remark: The formulation of the above statement assumes that the limit lim^oo ^S(p n ,p t j) 
exists and is independent of /. This follows from general principles and can immedi- 
ately be obtained from the existence and self- averaging of the low temperature specific 
free energy. 



2 Proof of the main results 



Notice first, that for all B > 0, the quenched limit fooifi) exists and is a convex function 
of f> [5]. Let B\ = 1. From the high temperature results [1], we have, almost surely, that 

/oo()8i) = lim -EjlogZniPuJ) = lim -logE/Z^,/) 

n— oo n n— oo n 

= / 00 Q6 1 ) = log2 + ^ 
= log2 + i 

The following figure 1 illustrates the definition of the inverse temperature B*; the an- 
nealed free energy /^QS) = log2 + ^- is plotted as a function of B and the straight line 
is defined by -j^fooifii) = Pfoo(fii)- The two graphs intersect at f3\ = 1 and /3* = 4log2 = 



3 



2,77258- • •. One can now easily check that, at p" = p"*, the annealed free energy f^if)*) 
is simply related to /oo(p"i) by the following relationship 

7co(/5.) = f +log2 = + ^log2) = ^do g 2 + i) = ^ /oo (pU 

4 p! 4 p* Px 4 Px 




Figure 1: The value p"* = 4 log 2, is given by the intersection of the graph of the annealed 
free energy (/}) with the straight line jS/^ ( 1 ) . 

We denote by T the mapping T : jU,^ (cr|/) >->• /J. n> p[cr\J) defining, for all p" > p"i, the 
Gibbs probability measure n n> p{cr\J) via the functional equation 

exp(-p-H ra (q,/)) m , n Zf /ft Q8i,7) 

Notice that fi/fii is a non dimensional quantity. Moreover the value p"i fixes the tem- 
perature scale i.e. the temperature /5 > /3i is expressed in units where fi\ = l. 

Since \i n< p is a probability on the configuration space, summing up over the config- 
urations a and taking the thermodynamic limit, we have indeed 

lim -log£>ra,M°"l^ = lim -logE^ / f 1 (a|/) + a oo ( ) 6 1 ^) = 0, 

n^oo n „ n— >oo n „ "'Pi 



(T 



where the limit (p^ , p") is given by 
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aioaiPup) = lim -^--logZntPuJ)- lim -logZ„(/3,7) 

n^oo p 1 ^ w— oo ft 

= lim ■^-—Ej\oe,Z n {B\, J) - lim — Ej\oo.Z n {B,J) (due to the self- averaging) 

n^oo ^ n^oo 72 

= !"/ooO8l)-/oo(0. 
Pi 

The existence, for all /3 > /3i, of the limit aoo{Pi,P) follows immediately from the exis- 
tence of the two limits /00Q61) and fooip)- Now, by making use of the relation between 
the limits f^tp*) and /00Q61), one can check, that for (3 = (3*, the limit <Xoo{P\,P*) gives 
the deviation of the free energy (/3» ) from its mean value : 

P* - 
«oo:=«oo(/3i,/3*) = —f 00 (Pi)-f 00 (P*) = f 00 (P*)-foo(P*)- 
Pi 



The proof of the proposition reduces thus in determining the value a ( 



Proof of the Proposition: At /3 = P\, the quenched limit /oo (p"i) equals the annealed one 
fooiPi) = /3f /4 + log2, where the term p\lA comes from the mean value of the Boltz- 
mann factor {i.e. the typical behaviour and the mean behaviour coincide at this tem- 
perature). Since for p > Pi, the typical and the average behaviour are no longer the 
same, we use the standard large deviations argument in order to make the deviant be- 
haviour at p* look like the typical behaviour at pV 

The affine mapping T on measures induces a transformation on the free energies 

reading f^iP*) = % + log2 = j^foo(Pi)- It follows that the pre-image of the term pi 14 
— coming from the average of the Boltzmann factor — (point C of the figure 2), is 
PiP* /4 = Pi log2 = log2 (point C'); one gets the value of the free energy f^Pi) if the 
term P\l4- 1/4 is added to this pre-image. We remark that the sheer particularity of 
the two temperatures Pi and /3* is that the pre-image oflog2 is 1/4! Therefore, to obtain 
the quenched limit at /3* is enough to add to the image of log2 {i.e. to the segment OC) 
the value 1/4 (segment CB). 

One can now easily check that the difference of the two limits /oo(/3*) and /oo(p"i), 
is simply given by the segment OA: 

/ooG8*)-/oo(0i) = (j8*-j8i)log2. 



Hence, 

B 2 B 2 1 

fcoifi*) = (P* - Pi) log2 + /ooQSO = j0* log2 + ^ = Z± + - = 2.1718 
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/3-7oo03) = ln2 + £ 
j6~j61og2 







Figure 2: The affine map T maps C' to C. The length of the segment A'B' corresponds 
to the value fooifii) that is parallel transported to the segment AB. The segment OB 
equals fooi/3*)- The dashed lines A' A and B'B are parallel to C'C. 



and, moreover 



a oo = /oo(/3*)-/ooQ8*) 

= 7r/ooG8l)-/oo08.3 

Pi 

4 4 ' 



One can check that the value of /oo(j6*) is slightly lower than the bound one can 
obtain by making use of the spherical model (2.2058 • • • )■ □ 



Proof of the Theorem: For f5* , we have 

1 . 1 



C/ip.) = lim -S(jU„ )j6 ,j) = - lim -£jU W)j8t (cr|/) log/ifffi 1 Z " - 



= - lim -Y/J-n.B, (Cr|/) log/if* /j6l (o-|/) - «oo, 

and, by the positivity of the entropy one checks readily that 

lim — YUnB (0"l/)l0gW n fl, ((T I/) < -^-«oo = "4; ~- 
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In the following, we shall show that this inequality is saturated. For this we introduce a 
slightly different notation. 

Let W n) ^ [a\J] = e~P lHn{a,n /2 n P l be the random weight associated with each con- 
figuration a £ Z n . The Gibbs measures jJ- n ,Pi iP\J) and ii n ,p* [a\J) are now given by 

and, 

Mn,j8. (<7 17) = V?^ • 



We have indeed, from the high temperature results, 

Mm ^Ejlog^Wn^alJ) = lim Ilog^^T^ = f + lo ^~^ 2 = ? 
and, from the previous proposition, 

i ^ H ik i / e -/Mfi.(ov/)\{r fi 2 6? i 

lim -£,logV M^ p ; /pi (o-|/)= lim -EjlogYl - = — - /3* log2 + ^ = -, 

z'.e. the behaviour of the sums 

la M^ft 17) and I ff WjJ^ 1 (<r|7) is the same. Thus, for 
the comparison of the two measures, namely for distinguishing between the behaviour 
of the summands W„ iPl (a\J) and W%*' Pl (a\J) we need additional information. 

We introduce the relative entropy density s[np t \[i Pl ) of the measure ii Pt w.r.t. the 
measure fi Pl which gives the extend to which the measure fi Pt "differs" from the mea- 
sure n Pl : 

s^ p J» Pl ) := \im±S^ n , p J» n , Pl ) = l^Z^,pM\n\og^^. 

This limit exists and it is a non-negative function vanishing in the case the two mea- 
sures are equal. We notice moreover that 



= lim — y u n g(a\J)\os — '■ 

1 p * -l 

= lim-X^^I7)logW n ^ [a\J). 
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Obviously, W^fHaW < ZoW^{a\J). Hence, 



limsup^^miog^Vl/) = Urn ilogfcwJ^WT) 
and, consequently, 

s^pMJ = jim ilog^^^l/)) * = 

where the equality of the limsup and the limit is a consequence of the positivity of 
l/^- 
Using now the functional definition of the measure one gets 

sW ^) = i^-z^^miog^-^ 

1 fii-i 
= lim - Y, Vn,p, iP\J) log/*- 1 *, (ol-fl + «oo 

= J^.-w- 

Recalling that atoo = ^{fi* — Pi), it follows immediately that 

lim -^jUn./jJalTHog/in^alT) = t^-"7 = -^aoo 

n^R a 4/3* 4 p* 

which proves the theorem. □ 

Remarks: Another interesting quantity is the relative entropy density s{fip t |v) of the 
measure ju„ ;j g t wr.t. the uniform measure v n {a) : 

sinpjv) = lim -S{fi Tli pJv n ) = lim -^fa^, (a|/)log ^ n ' P * ^ 

= -5(ju^) + log2 
= log2. 

(We recall that sCju/jJv) = + log 2 = fy = \). 

One can also easily check that the value of the limit corresponds to the entropy 
difference = sQu^) - s{fip t ). 



3 Concluding remarks 

In this note we showed that the mean entropy of the Gibbs measure vanishes at the 
inverse temperature ft* = 4log2. A related question concerns the Hausdorff dimension 
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of the support of the Gibbs measure. From our result on the entropy one can easily 
show that this dimension vanishes at /3* . 

A last observation concerns the value of the temperature /3*: it is obtained from 
the relationship between the free energies fooifi*) and fooW', moreover, one can read- 
ily check that /3* = fi 2 c , where /5 C = 2sJ\o%2 is the critical temperature of the Random 
Energy Model (REM). The REM is defined by 2" energy levels E^i = 1,- •• , ri), a fam- 
ily of random, independent, identically distributed random variables; many results are 
qualitatively the same as those of the SK model. It would be interesting to clarify this 
relationship in order to obtain some information on the behaviour and properties of 
the Gibbs measure at low temperatures. Both fi c and /3* are to be compared with the 
value at /3i = 1, i.e. the maximum value of ft where the free energies of the two models 
coincide. What we learn by the comparison of the two models is that the Gibbs mea- 
sure of the SK has seemingly a richer structure than for the REM. As a matter of fact, 
the entropy of the REM vanishes at /3 C while the entropy of the SK model is still strictly 
positive at this point. 
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